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Abstract 

Neural network and its adaptive wavelets (wavelet networks 
and wavenets) are used to calculate the wave induced 
hydrodynamic inline force acting on a vertical cylinder. In 
order to minimize the error of hydrodynamic force on 
vertical cylinder members in offshore structures, an offshore 
structure engineer needs to be able to make reliable 
prediction of hydrodynamic loads induced by waves. The 
Wavelet Neural Network (WNN) use wavelets as activation 
functions of its hidden layer neurons. In WNNs, both the 
position and dilation of the wavelets are optimized beside 
the weights, but there are different approaches to construct 
this kind of networks. In one approach of WNN construction 
that entitled wavenet, the position and dilation of the 
wavelets taken to be fixed and only the weights of network 
are optimized. In this research, wavenet and WNN are 
employed to predict the inline force time series of a cylinder 
using wave particle kinematics, namely velocities beside 
wave surface profile that are gained from experimental data. 
Numerical results demonstrate that the combination of 
neural network concept and wavelet theory i.e. wavenet and 
wavelet neural network provide a more robust tool 
considering its more appropriate prediction of any new data 
which the network had not experienced before for predicting 
the hydrodynamic inline force. Furthermore, WNN has the 
best results among the other methods. 
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Introduction 

Regarding to the increase in power and availability of 
digital computers, the more extensive use of 
nowadays theories potential in routine design works 
by naval architects and engineers has been one of the 
most important approaches. Most structures in the 
offshore and coastal regions like platforms, jetties, 
ocean bridges, seawater intakes and etc. are chiefly 
composed of tubular elements, whose design is 



dictated by severe gravity wave forces. Many 
cylinders failures due to extreme wave forces are 
reported in the literature. Though, the study of wave 
forces and moments on these kinds of members has 
been one of the main research areas and it has 
attracted the attention of many researchers in the past. 
In general, the forces on these elements due to sea 
waves can mainly be divided into two components so 
called inline force and transverse or lift force. The 
inline force acts along with wave propagation 
direction but lift force acts in transverse direction. The 
data of random waves used in this research were 
based on the JONSWAP spectrum of ¥1=1.5 m 
significant wave height and T=5.9 s mean period that 
they are exerted in a cylinder with 0.5 m diameter and 
the roughness of kid = 0.038. Fig. 1 shows inline and 
transverse force at a period of time. 

Most of the researchers have done a lot of 
investigations on these kinds of structures. The 
ultimate objective of such researches is to develop 
methods of design and construction which help 
produce structures to be safe, functional, economical 
and able to resist the forces induced by environment 
[1,2]. Some of investigations were carried out on 
hydrodynamic forces acting on the fixed cylinder or 
oscillating in a still water and several researches have 
been done on cylinders surging at the same frequency 
as the incident waves [3-5]. These kinds of forces on 
offshore structures are usually calculated using 
different theories such as Morison equation, 
Froude-Krylov theory, Diffraction theory and so on. 
Morison have proposed a simple empirical equation 
to estimate the velocity-dependent drag force and 
acceleration-dependent inertia force on vertical 
cylindrical members [6,7]. The hydrodynamic forces 
on cylinders under the action of waves are usually 
evaluated using the Morison's equation. Recently, 
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FIGURE 1 INLINE AND TRANSVERSE FORCE SIGNALS NORMALIZED AT A PERIOD OF TIME 



developments in soft computing methods such as 
Artificial Neural Network (ANN), Fuzzy Inference 
Systems (FISs), Classification and Regression Trees 
(CART) and Genetic Programming (GP) have 
rendered them more applicable. Ease of the 
application, as well as less required computational 
time, has made these soft computing methods more 
suitable for wave modeling. Some of investigators 
[8-15] employed soft computing methods for wave 
simulation. Jain and Deo presented many applications 
of ANN in different aspects of ocean engineering [16]. 
The traditional stochastic time series auto regressive 
methods have been also used for forecasting purposes, 
although the auto regressive models are less flexible 
in fitting to data than ANN models that are 
self-learning [17]. Deo and Naidu compared the 
results of forecasting using ANN and auto regressive 
models [8]. 

The main objective of this paper is the evaluation of 
neural network ability and its adaptive wavelets 
(wavenets) ability in predicting the inline force. The 
prediction of inline force time series of a cylinder is 
done using wave particle kinematics, namely 
velocities beside wave surface profile that are gained 
from experimental data. Therefore, experimental 
inline forces are used as output to develop the 
networks. In the present paper, first a brief review on 
neural network concept has been presented. After that 
an introduction to the fundamentals of wavelet theory 
is explained, consequently neural network adaptive 
wavelets (wavenets) and designing of a these 
networks are elaborated. Then the problem is defined 
in details and finally the simulation results are 
discussed. Through analysis and comparison of the 
most appropriate networks output with experimental 
results it has been found that wavenet approach gives 
the best quality of fit with available experimental data 
of hydrodynamic inline force on a vertical cylinder in 



comparison to neural network and consequently other 
theories. 

Artificial Neural Network 

An artificial neural network is a highly simplified 
model of the biological structures found in a human 
brain. It is one of the soft computing methods 
employed widely in the last decade for wave 
modeling. In this method, every input vector is 
related with the corresponding output vector [16]. The 
neural network contains computational elements 
called nodes or neurons, which undertake the task of 
combination of inputs and estimation of their weights. 

The characteristics of a neural network come from the 
activation function and connection weights. Since the 
neural network stores data as patterns in a set of 
processing elements by adjusting the connection 
weights, it is possible to realize complex mapping 
through its characteristics of distributed 
representations. The most commonly used network 
and training algorithm combination is the 
feedforward network with standard back-propagation 
algorithm [16]. This kind of multi-layer neural 
network has been applied successfully to solve many 
difficult and diverse problems [18] by training them 
with a highly popular learning algorithm known as 
back-propagation algorithm. 

Fundamentals of Wavelet Theory 

Wavelet theory is the outcome of multidisciplinary 
endeavours that brought together mathematicians, 
physicists, and engineers. This relationship creates a 
flow of ideas that goes well beyond the construction 
of new bases or transforms. The term wavelet means a 
little wave. A function hOL 2 (R) (the set of all square 
integrable or a finite energy function) is called a 
wavelet if it has zero average on (-<*>, + °°) [19]: 
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Jh(t)dt = (1) 

—00 

This wavelet must have at least a minimum oscillation 
and a fast decay to zero in both the positive and 
negative directions of its amplitude. These three 
properties are the admissibility conditions of a 
function that is required for the wavelet transform. 
The wavelet transform is an operation, which 
transforms a function by integrating it with modified 
versions of some kernel functions. The kernel function 
is called the mother wavelet and the modified version 
is its daughter wavelet. A function hUU(R) is 
admissible if 

TH(a>) 

c h = ——^-Akxco (2) 

• K> 

— CO 

where H(co) is the Fourier transform of h(t). The 
constant Q is the admissibility constant of the 
function hit). The wavelet transform of a function 
kUL 2 (R) with respect to a given admissible mother 
wavelet hit) is defined as 

+00 

w k (a,b)= J k(t)h*„(t)dt (3) 

-00 

where * denotes the complex conjugate. However, 
most wavelets are real valued. The daughter wavelets 
are generated from a single mother wavelet hit) by 
dilation and translation as follows: 

1 . / 1 — b. 

h..b(t) = - r h( ) (4) 

Va a 

where a > is the dilation factor and b the translation 
factor. The constant term of l/yfa is for energy 
normalization, which keeps the energy of the 
daughter wavelet equal to the energy of the original 
mother wavelet [19]. Fig. 2 provides the plots of a 
mother wavelets (Morlet) accompanied with their 
daughters that are created using mentioned 
procedure. 

Neural Network Adaptive Wavelet (Wavenet) 

The combination of the wavelet transforms theory 
with the basic concept of neural networks leads to a 
new mapping network called neural network adaptive 
wavelets or wavenets is proposed as an alternative to 
feedforward neural networks for approximating 
arbitrary nonlinear functions. The wavenet algorithms 
consist of two processes: the self-construction of 



networks and the minimization of error. In the first 
process, the network structures applied for 
representation are determined by using wavelet 
analysis. The network gradually recruits hidden units 
to effectively and sufficiently cover the 
time-frequency region occupied by a given target. 
Simultaneously, the network parameters are updated 
to preserve the network topology and take advantage 
of the later process. In the second process, the 
approximations of instantaneous errors are 
minimized using an adaptation technique based on 
the LMS algorithms. Each hidden unit has a square 
window in the time-frequency plane. The 
optimization rule is only applied to the hidden units 
where the selected point falls into their windows. 
Therefore, the learning cost can be reduced [19]. The 
important steps in training and testing of WNN or 
wavenet are summarized as follows: 

(a) A data set is generated and divided into the 
training and testing data sets. 

(b) The sigmoid activation function of feedforward 
neurons is substituted with a suitable daughter 
wavelet. 

(c) Appropriate values are assigned to dilation and 
translation factor of WNN neurons. 

(d) The WNN network is trained using training data 
set. 

(e) Performance generality of WNN network is 
checked using testing data set. 




-2 2 -2 2 -2 



FIGURE 2 MORLET MOTHER AND DAUGHTER WAVELETS 

(f) If performance generality is satisfactory, the 
training process is terminated; otherwise step (g) is 
performed. 

(g) Another value is assigned to dilation factor of 
WNN neurons. 

(h) Steps (d)-(h) are repeated until the proper solution 
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is met [20]. 

Wavenet Algorithm 

The inversion formula of (5) cannot be expressed 
directly by finite neural networks (NN), but can be 
approximately realized using NNs topology with finite 
hidden units. This is so because most targets are 
restricted in both the time and frequency domains. The 
approximated signal of the network y(t) can be 
represented by: 



IX 

y(t) = u(t)£w k h atbk (t) 



k=l 



(5) 



where K is a number of windowing wavelets, and Wk 
is the weight coefficients. The neural network 
parameters Wk , at , and bk can be optimized by 
minimizing a cost function or the energy function, E, 
over all time t . Thus by denoting 



e(t) = y(t)-y(t) 



(6) 



be a time-varying error function at time t, where y(t ) 
is the desired (target) response. The energy function is 
defined by 



^ t=i 



(7) 



To minimize E it can be used the method of steepest 



descent, which requires the gradients 



BE BE 



5w t da b 



and 



dE 
dh 



for updating the incremental changes to each 



particular parameter Wk, ctk, and bk respectively. For 
Morlet mother wavelet, gradients of E are 



_oe_ 

3w,, 



= -£e(t)h(T)u(t) 



t=i 



dE ^ , N , N 8h(x) 
= -£e(t)u(t)w k 



5b 



db, 



dE 8E AU 8E 
Aw = — ; — ,Aa = ,Ab = - 



dw k ' 5a k ' db k 



(11) 



thus each coefficient w, b, and a of the network is 
updated in accordance with the rule 



w(n + 1) = w(n) + |u w Aw 



b(n + l) = b(n) + u w Ab 



a(n + 1) = a(n) + |u w Aa 



(12) 



(13) 



(14) 



(8) 



(9) 



where \i is the fixed learning rate parameter [19]. 
Results and Discussion 

The data used in this research are from the 
experiments done in delta wave flume of Delft 
Hydraulics Laboratory (DHL) in Netherlands (LIP 
Project 10D) [21,22]. The flume is approximately 250 
m long, 5 m wide and is normally filled with water to 
a depth of 5m. The waves were generated by a 
hydraulically driven plane wave board and their 
energy is dissipated at the other end of the flume 
through the use of a sloping concrete beach. The 
random waves used in the tests were based on the 
JONSWAP spectrum of H=1.5 m significant wave 
height and T=5.9 s mean period. The performances of 
different models were assessed based on calculating 
the error indices of Mean Absolute Error (MAE), and 
the Root Mean Square Error (RMSE). The coefficients of 
determination (<p 2 ) and correlation (R) of linear 
regression between the predicted values from the 
models and the desired output is also used as a 
measure of performance. The four statistical of RMSE, 
MAE, <p 2 and R parameters formulas that are used to 
compare the models performances are as follows: 



RMSE: 



1 



|> k -y k ) 2 



k=l 



(15) 



N 



da 



Where x = 



dE ^ , N , N 8h(x) dE 

= -2>(t)u(t)w k T— ^ = X- 



db v 



9b v 



t-K 



(10) 



The incremental changes of each 



coefficient are simply the negative of their gradients, 



MAE= iZl t k-y k | 

k=l 



N 

2>k-y k ) 2 



k=l 



(16) 



(17) 
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ZL (tk ~ tk)(yk ~ yk) 
ZL (tk -^ )2 ZL (yk -^ )2 



(18) 



where U and y; are target and network output for the 

i'th output respectively and t k is the average of 

target outputs and N is the total number of events 
considered. The models that minimized the two error 
measures beside the optimum of <p 2 and R are selected 
as the best one. The whole analysis was repeated 
several times. 

In this study different algorithms for feed forward 
neural network were studied in order to select the 
optimum neural networks and the most proper 
training algorithm and training function were found 
to be conjugate gradient and Levenberg Marquardt, 
respectively. For neural network, the sigmoid and for 
wavenets, Morlet wavelets were also employed as 
transfer functions for each network in their hidden 
layer neurons. MATLAB is utilized for training and 
testing the networks. The number of hidden layers 
and their nodes depend on the complexity of the 
patterns, the network transfer functions and the 
nature of the problem to be solved. In order to rapid 
train of the networks and their simplicity, one hidden 
layer is chosen for all of them. Learning rate and 
iteration were 0.01 and 400 respectively, while training 
automatically stopped when the mean square error 
increased. 70% of data were selected for the training 
stage and the remaining 30% were used for testing. 
This division of the data satisfied the statistical 
similarity required for selecting the training and 
testing data. Other percentages were also tested and 
the performances of the models did not change 
significantly. The training data set is used to train the 
networks, whereas the testing data set is used to 
verify the accuracy of the trained neural network and 
WNN models for the prediction of hydrodynamic 
inline force. Three important variables selected as 
input neurons contain wave surface height from still 
water level, horizontal velocity and vertical velocity. 
Table 1 shows the range of different input and output 
parameters for training and testing data sets of the 
random waves used in these tests. Fig. 3 and Fig. 4 
respectively demonstrate fitting error signal and 
linear regression between predicted signal of recent 
neural network prediction and experimental data set 
for training and testing samples. 



As activation function of hidden layer neurons in 
standard feedforward neural networks is a sigmoid 
function, in order to increase the performance 
generality of them, activation functions is substituted 
with Morlet wavelet functions to create its wavenet. 
The resulted networks are trained by the same 
method employed for training the feedforward 
network. With this training method, the values of 
dilation and translation factors of hidden layer 
wavelet activation functions were set using trial and 
error procedure. Equation (10) is Morlet daughter 
wavelet that was substituted in activation functions of 
the feedforward neural network hidden layer neurons 
because of its high performance among other wavelets. 
A typical topology sample of wavenet is shown in Fig. 
5. 



h(i) =exp( — — )cos(5x) 



(19) 



Mttriian practical equation approach far training data set: R=0jS9&6 




Morison practical equation approach for testing data swfc R=D.9Z9fi* 




FIGURE 4 LINEAR REGRESSION BETWEEN ANN AND 
EXPERIMENTAL MEASUREMENTS. 
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TABLE 1 LIMITS OF USED DATA SET DIVIDED IN TO TWO PARTS, TRAINING AND TESTING SAMPLES 



Effective Parameters 



Training data 
(7000 samples) 



Testing data 
(3000 samples) 







Min 


Ave 


Max 


Min 


Ave 


Max 




H: 
















Wave 
surface 


-1.0253 


-0.0144 


1.4577 


-0.8569 


-0.025 


0.9499 




height 














Input 


Vx: 














Parameters 


Horizontal 
velocity 


-1.4688 


-0.0689 


1.1685 


-1.4190 


-0.105 


0.8889 




Vy: 

Vertical 


-0.7402 


0.0071 


0.7915 


-0.7642 


0.0222 


0.6738 




velocity 














Output 
Parameter 


Fx: In-line 
force 


-929.46 


-22.71 


1098.7 


-782.67 


-26.98 


770.341 



500 



-500 



RMSE= 107.0825 
MAE = 77.6113 




180 190 200 210 220 230 240 

c (sec) 



250 



FIGURE 3 FITTING ERROR SIGNAL OF PREDICTIONS ACHIEVED FROM ANN AND EXPERIMENTAL DATA SET 




Hidden layer 

FIGURE 5 A TYPICAL TOPOLOGY SAMPLE OF WAVELET 
NEURAL NETWORK 



Fig. 6 and Fig. 7 respectively demonstrate fitting error 
signals of predictions achieved from wavenet and 
experimental data set. Fig. 8 and Fig. 9 also is linear 
regression between predicted signal of wavenet and 
experimental data set for training and testing samples. 
Table 2 contains RMSE, MAE, determination and 
correlation coefficients values for neural network, 
wavenet and wavelet network approaches and 
subsequently Fig. 10 shows a comparison between the 
predictions of these procedures with experimental 
dataset. Figs. 11 and 12 also provide diagrams contain 
mentioned indices in order to better comparison 
between the networks efficiencies. 
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FIGURE 6 FITTING ERROR SIGNAL OF PREDICTIONS ACHIEVED FROM WAVENET AND EXPERIMENTAL DATA SET 
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FIGURE 7 FITTING ERROR SIGNAL OF PREDICTIONS ACHIEVED FROM WAVELET NETWORK AND EXPERIMENTAL DATA S 



1 1 1 1 
RMSE = 106.9698 
MAE = 75.7953 


i i i 







Neural network for training data set: R=0.93102 



SL0G1 wavenet for training data set: (4=0.9479 




-500 500 1000 

Target 

Nenral network for testing data set: R=0.9324 





-600 -400 -200 200 +00 600 
T.i rgct 

SI.OC 1 wjwiiiot for testing data set: R-0.942. r >(! 




FIGURE 8 LINEAR REGRESSION BETWEEN WAVENET AND 
EXPERIMENTAL MEASUREMENTS. 



FIGURE 9 LINEAR REGRESSION BETWEEN WAVELET 
NETWORK AND EXPERIMENTAL MEASUREMENTS 
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TABLE 2 RMSE, MAE, DETERMINATION AND CORRELATION COEFFICIENTS FOR ANN, WAVENET AND WAVELET NETWORK 

APPROACHES 



Adapted 
procedure 



RMSE 



MAE 



Determination 
coefficient (c)) 2 ) 



Correlation coefficient 
(R) 



Train Test Train Test 



Train 



Test Train 



Test 



ANN 



126.6529 107.0825 77.4296 77.6113 0.802995 0.854146 0.8966 0.92984 



Wavenet 



104.1595 103.1087 82.5697 81.327 0.866761 0.864714 0.93102 0.9324 



Wavelet 
network 



85.5046 106.9698 64.195 75.7953 0.898514 0.886799 0.9479 0.94258 



Experimental, ANN, wavenet and wavelet network signals comparision 



1000 



ANN 



• Experimental signal Wavenet 



Wavelet network 




250 



FIGURE 10 ADAPTATION CIRCUMSTANCE BETWEEN PREDICTED SIGNAL OF ANN, WAVENET AND WAVELET NETWORK 

APPROACHES WITH EXPERIMENTAL DATA SET 



u RMSE MAE 




B Determination coefficient [tp2] 
m Correlation coefficient (R) 



ANN Wavenet Wavelet 
network 

FIGURE 11 RMSE AND MAE ERRORS COMPARISON FOR ANN, 
WAVENET AND WAVELET NETWORK METHODS FOR TESTING 
DATA SET 



0.944 
0.924 
0.904 
0.884 
0.864 
0.844 
0.824 
0.804 

ANN Wavenet Wavelet 
network 

FIGURE 12 DETERMINATION AND CORRELATION 
COEFFICIENTS COMPARISON OF TESTING DATA SET FOR ANN, 
WAVENET AND WAVELET NETWORK METHODS 
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Conclusion 

To minimize overall project costs and the risk of 
damage as a result of designation of vertical cylinders, 
the engineer who designs the project needs to be able 
to make reliable predictions of the amount of 
hydrodynamic inline force. This paper has proposed 
new methods based on wavelet transform theory and 
neural network basic concept that called wavenet and 
WNN as an alternative to feed forward neural network 
for approximating the hydrodynamic inline force and 
the potential for applying neural network and its 
adaptive wavelets has been shown. As it is obvious 
from the results that artificial intelligence methods can 
be employed for predicting wave induced 
hydrodynamic inline force on a vertical cylindrical 
member in comparison with other computational and 
time consuming methods since their application is not 
restricted to the use of coefficients that should be 
determined experimentally for any environmental 
condition. Numerical results indicate that substituting 
different wavelet functions as feedforward neural 
network transfer functions can enhance the network 
performance and efficiency. Therefore proposed WNN 
and wavenet with feedforward neural network 
structure that uses Morlet wavelet function as its 
hidden layer activation functions is much better in 
comparison to the standard feedforward in terms of 
performance generality and furthermore wavelet 
network can be the best recommendation in estimating 
the hydrodynamic inline force due to wavelets 
impressive properties. 
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